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Abstract 

The heat theorem (i.e. the second law of thermodynamics or the ex- 
istence of entropy) is a manifestation of a general property of hamilto- 
nian mechanics and of the ergodic Hypothesis. In nonequilibrium ther- 
modynamics of stationary states the chaotic hypothesis plays a similar 
role: it allows a unique determination of the probability distribution 
( called SRB distribution on phase space providing the time averages 
of the observables. It also implies an expression for a few averages 
concrete enough to derive consequences of symmetry properties like the 
fluctuation theorem or to formulate a theory of coarse graining unifying 
the foundations of equilibrium and of nonequilibrium. 

1 Boltzmann's Heat Theorem 

In equilibrium statistical mechanics states are identificed with time invari- 
ant probability distributions // on phase space. Thermodynamic functions, 
identified with time averages of mechanical observables, are expressed as 
integrals {F) of suitable mechanical obeservables F. The averages depend 
on control parameters a, like volume, energy, kinetic energy. Under changes 
b da of the control parameters the thermodynamic quantities change so 
that the variation of the average energy and the variation of the volume 
are dU and dV and are related to the time averages of the kinetic energy 

{K) =^ {J2f=i ^) =^ ^NkBT and of p =^ {-dyU), with U being the total 
potential energy, so that, expressing p, T in terms of the control parameters: 

Heat Theorem: (HT) Changing a — > a + da induce changes dU , dV , with 



2: Thermostats and reversiblity 



2 



= exact dS, (1-1) 

under the ergodic hypothesis, or equivalently under the assumption that the 
distributions fj, are elements of one among the classical ensembles, like mi- 
crocanonical, canonical, . . . , [D [2] ■ 

In modern terminology: the ergodic hypothesis (EH) imphes equihbrium 
statistical mechanics. The guiding idea is that HT holds for all (ergodic) 
systems with Hamiltonian of the form H = K + U: whether having few 
(~ 1) or many (~ 10^^) degrees of freedom, as long as EH holds. This 
means that HT is a trivial consequence of the Hamiltonian structure of 
the mechanical systems describing the microscopic motions. It is always 
valid, like a symmetry property, and it is highly nontrivial in systems with 
many degrees of freedom, being the second law of thermodynamics. In other 
words a guiding idea to understand certain universal laws is that they merely 
reflect symmetries or general stuctures, of the underlying equations, which 
may have deep consequences in large systems: e.g, via the HT, the roots of 
second law can be found, [IJ, in the simple properties of the pendulum. 



2 Thermostats and reversiblity 

Stationary states out of equilibrium are realized when on a system are 
present staionary currents. In such systems currents generate, by dissi- 
pation, heat that is absorbed by thermostats. 

Recent progress has been achieved by employing simple models of the 
thermostats with the feature of being finite systems of particles, hence well 
suited for simulations. There are various types of thermostats considered in 
the literature. As a rather general class of thermostats model consider 




Fig.l: Co ("system") interacts with shaded Tj ("thermostats") constrained to keep 
fixed kinetic energy Kj = = ^N^ksT-j. 

The equations of motion for the A''o,A^i,... particles located in con- 
figurations X = (Xq, Xi, . . .) inside the containers Co, Ti, . . . (if here Xj = 
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(xj^i, . . . , Xj^AT^. ) will be (as an example with all masses equal), E= positional 
"stirring forces" , Uj internal energy in the j-th container, Wqj potential en- 
ergy of interaction between the particles in Cq and those in Cj) 

mXo = - 5xo (c/o(Xo) + E W^o,,(Xo, X,)) + E(Xo), 

i>o (2.1) 
m±i = - (UiiXi) + Wo,i{^o, X,)) - a^X, 

The energies C/q, Uj, Wqj should be imagined as generated by pair potentials 
ipQ,ipj,ifQj short ranged, smooth, or with a singularity like Lennard-Jones 
type at contact, and by external potentials modeling the containers walls), 
ai determined so that Ki = ^NiksTi = const. 

More generally thermostats can even act on regions of Cq: eg. in electric 
conduction models analogous to Drude's model (1899!), one imagines that 
the collisions with the lattice communicate energy to the lattice vibrations 
("phonons") and this is modeled by adding a constraint that ^Xq = I/c^Tq 
keeping the total kinetic energy of the Nq particles in Cq identically constant 
realized by an extra term — ooXq in the first of Eq. (j2.2p with ao suitably 
chosen. The multipliers aj in Eq. (j2.2p are readily computed by imposing 

constancy of Ki = const'^= ^NiksTi and are 

Qi — Ui . 
SNiksTi 

and Qi = work per unit time done by Cq on Cji 

=^ - X, • dx,WQ,i{Xo, X,) (2.3) 

and it is naturally interpreted as the heat ceded per unit time to the ther- 
mostat Cj. 

The main feature of the above equations is that they are not Hamiltonian 
and, therefore, the phase space volume measured by the divergence (t(X, X) 
is not zero, and after an algebraic computation is checked to be (neglecting 
for simplicity factors of the form (1 — 3^)) 

a(X,X) =e(X,X) + W^(X), 

This is a sum of two terms, one of which has the interpretation of entropy 
increase of the thermostats per unit time while the other is a time deriva- 
tive. Therefore one term is accessible not only in simulations but it is also 
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conceivable that it can be measured in experiments; the other is instead 
strongly model dependent, coordinates dependent and metric dependent. 

Abridging often (X, X) simply by x and changing coordinates or metric 
the expression for a changes as cr'{x) = cr{x) + ^r(x) with a suitable T. 
Therefore only time averages over long times can have "intrinsic" meaning 
because 

- r a'{Stx)dt = - r a{Stx)dt + ^('grx) - T{x) ^^^^^ 

T Jo T Jo T 

SO that the two averages of a and a' have the same limiting behavior as 
r — > oo, at least if T is bounded. Hence if the Uj are bounded (as we shall 

suppose for simplicity) and if the average (T+ lim - [Z a(Stx) exists 

then it can be identified to entropy creation rate 

Furthermore the probability distributions in the stationary states of the 
averages of a and e over finite time r coincide asymptotically as r — > oo 
because 



- r a{^Stx)dt = - r e{Stx)dt + — : (2.7) 

T Jo T Jo T 

for large r the averages of a and e have the same fluctuations statistics. Not 
just the same average: {a) = (e). 

Hence a general theory of fluctuations of long time averages of a, if at 
all possible, will imply a general theory of fluctuations of e. And the latter 
is a quantity accessible experimentally via calorimetric and thermometric 
measurements without need of the equations of motion. 

A further important feature of the model is that its equations, Eq.) l2.ip . 
have a time reversal symmetry. This means that there exists a map / of 
phase space which is isometric and smooth with 1^ = 1 and ISt = S-tl if 
t — >■ ^^(X, X) denotes the solution to the equations of motion with initial 

def 

datum (X, X), X = (Xo,Xi, . . .). In this case I can be simply defined as 
/(X,X) =^(X,-X). 
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3 Chaotic hypothesis 

Having identified entropy creation rate with a microscopic mechanical quan- 
tity has been a key step towards the understanding of nonequilibrium steady 
states. In a way it might turn out to be as important as the realization, 
marking the beginning of statistical mechanics, that in equilibrium the av- 
erage kinetic energy has to be identified with the absolute temperature. 

To turn the above "discovery", OH], into a few quantitative predictions 
of properties of steady nonequilibrium states it is necessary to identify the 
probability distributions on phase space that can be used to yield the ime 
averages of the observables. 

The difficulty is that unless (T+ = 0, Eq. (j2.6p . such probability distri- 
butions must give probability 1 to a set of data which has volume. This 
kind of problem arose in the theory of turbulence and was solved by Ruelle's 
proposal, [5j, that the system (for instance the Navier Stokes evolution) is 
so chaotic that it can be regarded as having an axiom A attractor. 

The idea has been extended to the dynamics of thermostatted systems. 
It is convenient to formulate it in terms of a map S between timing events, 
i.e. by imagining to perform observations every time a prefixed event takes 
place or, mathematically, every time the trajectory crosses a prefixed surface 
S in phase space. The time evolution can then be described by a map S 
defined on S and mapping an x € S into the next point Sx where the 
trajectory of x crosses again S {^^Poincare's map on S"). In this case the 
phase space contraction is the logarithm of the Jacobian determinant of the 

map S: namely ct{x) — log | det dS{x)\. 

It should be remarked that the time between two successive events is in 
general variable as a function of the point x: calling it t{x) the map S and 
the solutions t Stx of the equations of motion are related by Sx = Sfi^^-^x 

and therefore for x € S it is ^{x) = Jq^^^ a{Stx)dt, and Jq F{Stx)dt = 

The mentioned extension is obtained by formulating the 

Chaotic hypothesis (CH) Motions developing on the attracting set for 
map S representing the evolution of a chaotic system of particles, observed 
in discrete time via a choice of timing events S, may be regarded as motions 
of transitive hyperbolic system. 

Informally such a system (also called Anosov system) has a dynamics 
with the property that following the motion of any initial datum x the 
nearby points separate from it exponentially fast, in the future and in the 
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past, except when located on a surface Ws{x) through x or, respectively, on 
another surface Wu{x). 

The assumption has to be understood in the same sense as the EH: 
the latter, as in Ruelle's view in [6], can be commented as "... while one 
would be very happy to prove ergodicity because it would justify the use of 
Gibbs' microcanonical xensemble, real systems perhaps are not ergodic but 
behave nevertheless in much the same way and are well described by Gibbs' 
ensemble...'''' . 

Under the CH the following properties hold: 

(1) there is a unique distribution /x such that, for all x outside a set of zero 
volume, 



hm 1 ^ F{S^x) = f f,idy)F{y). (3.1) 

(2) the probability distribution has an "explicit" expression "similar to 
the equilibrium Gibbs distribution", [7j. 

(3) iJ, is concentrated on a volume "attractor" . 

The distribution is called the "SRB distribution" (acronym for Sinai- 
Ruelle-Bowen) . Because of the above properties Anosov maps are considered 
a paradigm of chaos, much as harmonic oscillators are considered paradigms 
of order. They enjoy several interesting properties. Consider the finite time 

average / =^ ^ Ef=o' ^i^'^), then 

Fluctuation Law: There are values /i,/2 such that f is in [a,b] C (/i,/2) 
with ^-probability Prob^{f € [a, 6]) ~ ^^^fU) {ji ffi^ sense that 

hm 1 log Prob^if G [a, b]) = max Cf(/), (3.2) 

N^oo iV f&[aM 

and Cf(/) is analytic and convex in (/i,/2). 

More generally, ^8], given n observables F = {Fi, . . . ,Fn), there exists a con- 
vex open set T C , m < n, with the property that if A CT is a closed set 

and fj =^ ^ Ef="o^ Fj{S''x), then 



Prob^ii E A) = Prob^iifi, ...,/„) G A) oc.^oo e^^^^f^^^W (3.3) 
with (^F analytic and convex in T. (Sinai, ^). 

The function (^p is a kind of thermodynamic function and via the men- 
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tioned expression of /i it is possible to obtain an explicit (generally "uncom- 
putable") expression of stationary averages (F)^ and of Cf- 

4 Fluctuation Theorem 

Consider time reversal symmetric evolutions, see Sec. 2. If the dynamics is 
a discrete one, associated with a Poincare section S and a time reversal 
symmetric evolution, a time reversal symmetry / will be smooth map / of S 
with the properties 1^ = 1 and IS = S~^I. It can be obtained by restricting 
to the timing events map the symmetry in continuous time provided the 
Poincare section S is chosen so that IT, = T, (just replace S by S U IT,). 
Assume : 

(1) chaotic hypothesis 

(2) dissipativity, i.e. the average phase space contraction c7_|_, in Eq (j2.6p . is 
positive, (T+ > 0, and 

(3) time reversal symmetry by a map /. 

Let Fi = ^ and p =^ /i = i Ek=o ^ where a{x) =^ -log 1 det dS) \ . 

Then, unmn, 

Fluctuation Theorem (FT): There is p* > 1, see fll]/ . such that the 
symmetry 

Ci-p) = C{p)-pa+, \p\<P* (4.1) 

holds. More generally if F2, . . . , Fn are any other n — 1 functions of well 
defined parity under time reversal (i.e. even, Fj{Ix) = Fj[x), or odd, 
Fj{Ix) = —Fj{x) ) then setting IFj = Fj for Fj even and IFj = —Fj for Fj 
odd it is 

a-p, If2, ...,//„) = dp, /2, • • • , fn) - Pcy+ (4.2) 

The physical interpretation of pcj+ as the average of the the thermostats 
entropy increase rate £n = jfJ2k=o ktr ' ™^kes the theorem of physical 
interest because, as mentioned, \s a. measurable quantity independently 
of the model. 

The Eq. (|4.2p is a special case of an even more general relation that 
is closely related to the Onsager-Machlup theory of fluctuation patterns, 
\\.2\ [T3l I14j . The question is which is the probability that the successive 
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values of Fj{Stx) follow, for t G [— r, r], a preassigned sequence of values, 
that will be called pattern (p{t), [8\. 

In a reversible hyperbolic and transitive system consider n observables 
Fi, . . . ,Fn which have a well defined parity under time reversal Fj{Ix) = 
±Fj{x). Given n functions (pj{t), j = 1, . . . ,n, defined for t G [— ^, ^] the 
question is: which is the probability that Fj{Stx) ~ for t G [— ^l*^ 

The following, [8], gives an answer: 



Fluctuation Patterns Theorem (FPT): Under the assumptions of the 
fluctuation theorem given Fj , ipj , and given e > and an interval A C 
{—p*,p*) the joint probabilities with respect to the SRB distribution that 
Fj{Stx) follows the pattern ipj{t) or the "time reversed pattern" ±ipj{—t) 
(the sign depending on the parity of Fj) are related by 

Pf,i\Fj{Stx) - (pj(t)|j=i,...,„ < e,p G A) 



Pf,{\Fj{Stx) T ^j{-t)\j=i,...,n <e,-pe A) (4 3) 



exp(r max pa^^- + 0(1)) 

pGA 



where sign choice =F is opposite to the parity of Fj and p'^= ^ J^t "^^'^^ dt. 
The relation holds for patterns which can be realized with a probability that 
does not vanish faster than exponentially in time. 

The FPT theorem means that "all that has to be done to change the time 
arrow is to change the sign of the entropy production" , i.e. the time reversed 
processes occur with equal likelyhood as the direct processes if conditioned to 
the opposite entropy creation. This is made clearer by rewriting the Eq. (j4.3p 
in terms of probabilities conditioned on a preassigned value of p; in fact up 
to e'-'(^) it becomes, p!3], for \p\ < p*: 

P^{\F,{Stx) - ^,{t)\j=i_n < e, \ p) ^ 
P^,i\FjiStx)T^j{-t)\j=i,...,n <e,\-p) ^ ■ ' 

5 Consequences and comments 

(i) In stationary states of reversible dynamics heat exchanges are constrained 
by (as remarked by Bonetto, [l3| Eq.(9.10.4)]), 



Uit) 



dt 



(e "B-^i ) = 1, (5.1) 
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in the sense that - log (•) r-^oo^ 0- Not to be confused with the formulae of 
|15| (and the later developments) dealing with properties either of equilib- 
rium distributions or of distributions with density in phase space. 

(ii) It should not be thought that p* is proportional to the maximum of 
the finite time averages of e{Stx). The value of p* is the maximum value 
of p observable with a probability which does not tend to zero faster than 
exponentially as time tends to oo, see [TT]. This is analogous to the fact that 
in a hard sphere gas the close packing density is not the maximum of the 
density observable in finite volume. 

(iii) it has been claimed that the CH is not necessary to prove FT: this is of 
course obvious. However some nontrivial assumption is necessary: the CH 
is a simple general property that captures the essential role of chaos, just as 
the harmonic oscillators systems capture the essence of the ordered motions. 

(iv) The timed observations are closer to the physical applications than the 
observations in continuous time but it is, at least mathematically, interesting 
that the FT can be extended to continuous time observations, |16j . In phys- 
ical applications, however, there may be an essential difference between the 
continuous version and the discrete one because sometimes the interaction 
potentials are modeled by forces which diverge at contact (e.g. when the in- 
teraction is of Lennard-Jones type) or in some special configurations. Then 
one cannot suppose that the system is Anosov because the spurious term 
W in the phase space contraction, Eq. (|2.4p . can become large with a proba- 
bility that is "just exponentially small": and this will affect the fluctuation 
relation, [17]. The problem can be avoided by using timed observations: 
provided care is adopted in the choice of the timing events. One simply has 
to choose them so that the Poincare section S does not contain the singular 
conficurations. In this way the contribution from the spurious terms, which 
has the form ^{W{t) — W{0)), Eq. (j2.7p . will tend to zero as f — > oo and will 
be eliminated from the statistics of the entropy because W will be bounded 
at the times and r where it needs to be computed, [T7]. 

(v) In the checks of the fluctuation relation it is necessarily true that the 
time T has to be kept finite: looking at the proof of the FT, [101 lllj . the 
problem of the finite r corrections, needed because the FT deals with an 
asymptotic property as r ^ oo, can be attacked and quantitatively studied, 
at least in some cases, |19j , by following ideas employed to deal with "finite 
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size effects" in statistical mechanics. 

(vi) The extended form of the FT, Eq. (|4.2p . has been used to show that 
in the hmit of forcing the FT reduces to the ordinary fluctuation dissi- 
pation theorem, thus implying the Green-Kubo relations and Onsager reci- 
procity in reversible systems satisfying the CH, [20|. However assuming 
time reversibility only at 0-forcing and the CH it is sufficient to obtain the 
fluctuation-dissipation theorem, |21j . 

(vii) It has been claimed in the literature that the FT is a consequence of 
an analogous property of the equilibrium distributions: this is an erroneous 
claim, see p2] for a counterexample (which can be easily extended to cover 
even cases of very chaotic systems (a remark by F.Bonetto)). It is not pos- 
sible to infer a property valid on the zero volume attractor from a property 
checked outside it. 

(viii) It has been claimed that o"+ > is not necessary in the proof of FT: 
this is also not correct. It is essential not only because it appears in the 
denominator of the very definition of p but because positivity is used in the 
proof, see [11]. The error might be explained because the relation is written 
as a property of the not normalized A = pa^ without conditions on the size 
of A: which is very misleading because it deals with a quantity which could 
be if CJ+ = 0. It is physically obvious that the relation FT holds for p in 
the domain of definition of which is certainly finite under the CH, [llj . 

(ix) Since the chaotic hypothesis is never strictly speaking realized one refers 
to Eq. (l4.1[ ). (j4.2p as a fluctuation relation (FR), and its test is a test of the 
chaotic hypothesis, in analogy with the tests of the ergodic hypothesis. So 
far there have been several studies of the FR via simulations. However there 
are only preliminary experimental results in experiments designed to check 
it in cases in which the system is not clearly modeled by equations on which 
a complete theory is also possible, [23] . A common feature to the attempts 
made so far to test the FR is that the function ({p) turns out to be not 
convex: a nice discussion of one of the reasons for this phenomenon can be 
found in |2l] . 

(x) Perhaps the deepest consequence of the CH is the possibility of a precise 
theory of coarse graining: see for a heuristic discussion from a Physicist 
viewpoint. The view stems out of the proof in [IHIIII] of the FT and explains 
it, see also [25]. Furthermore the precise formulation of coarse graining 
leads to a discussion of the possibility of extending the notion of entropy to 
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systems in steady non equilibrium, It also leads to an analysis of the 
irreversibility of processes and to a quantitative evaluation of their "degree 
of ireversibility" , [27| . 



(xi) Reversibility is a delicate point: it might seem that it makes any check 
of the FR impossible, except in simulations. This is discussed in several 
places in the literature, see |28J. 

(xii) The CH is related, as mentioned, to the theory of turbulence. Con- 
versely the analysis of the CH anf the fluctuation theorems has implications 
on the theory of turbulence, [29l [71 [H]. 

(xiii) The theory can be extended to quantum systems, [7j, modeled by 
finite thermostats. Considering the system in Fig.l let H be the opera- 
tor on L2{Cq^°), of symmetric or antisymmetric wave functions H = 
-^Axo + UqP^q) + T.j>o {Uoji^o, Xj) + [/j(Xj) + Kj), parameterized by 
the configurations (Xj,Xj)j>o of the particles in the thermostats (here 
Kj'^= ^^"j) and consider the classical dynamical system on (^', ({Xj}, 

-ih^{Xo) = (F^')(Xo), 

(5.2) 

X, = -{djUjiX,) + (a,C/,(Xo,X,))^) - a,X, j > 

where the multipliers aj are such to constrain the classical thermostats to 
have a constant kinetic energy Kj = ^NjksTj 



de_f {Wj)i^ Uj def ■ , , 

^ ~ 2Kj ' ^' ~ - Xj • dj-tVoiiXcXj-j 

a(x, X) ^ £(x, X) + iy(x) '"Hy.Sf + w 



(5.3) 



which is time reversal symmetric if /(^',X,X) = (\I',X, —X). If the CH is 
assumed the FT is expected to hold for this model, hence for the entropy 
creation rate, e. See for more details [7]. 
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